"The highlighted tokens are overwhelmingly function words, pronouns, and common morphemes or syllables that serve as grammatical connectors in Thai, such as markers for possession, location, time, or subject/object reference. There is a strong emphasis on high-frequency, short tokens that are essential for sentence structure and meaning, including prefixes, suffixes, and particles that modify or clarify the main content words. These tokens are crucial for the cohesion and flow of Thai sentences."
Score Type | Accuracy | Precision | Recall | F1 score | TPR | TNR | FPR | FNR |
---|---|---|---|---|---|---|---|---|
detection | 0.66 | 1.0 | 0.32 | 0.485 | 0.32 | 1.0 | 0.0 | 0.68 |
fuzz | 0.57 | 0.613 | 0.38 | 0.469 | 0.38 | 0.76 | 0.24 | 0.62 |